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^ ■ ABSTRACT 

^ I In the setting of additive regression model for continuous time process, we establish 

^ ! the optimal uniform convergence rates and optimal asymptotic quadratic error of additive 

■ regression. To build our estimate, we use the marginal integration method. 
00 ' 
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^ 1 Introduction and motivations 

+^ ■ The multivariate regression function estimation is an important problem which has been 

extensively treated for discrete time processes. It is well-known from (jnl ) that the additive 
regression models bring out a solution to the problem of the curse of dimensionality in non- 
^ , parametric multivariate regression estimation, which is characterized by a loss in the rate 
of convergence of the regression function estimator when the dimension of the covariates 
increases. Additive models allow to reach even univariate rate when these models fit well. 
^ , For continuous time processes, (Q) obtained the optimal rate for the estimator of multivariate 
^ , regression, which is the same as in the i.i.d. case. He even proved that, for processes with 
O ■ irregular paths, it is possible to reach the parametric rate. This one, called the superoptimal 
rate, does not depend on the dimension of the variables, but the needed conditions on the 
^ I processes are very strong. That is the reason why it is relevant to study additive models to 
^ ' bring out a solution to the problem of the curse of dimensionality. 

Let Zf = (Xt, Yf), (t E M) be a M'^ x M- valued measurable stochastic process defined on a 
probability space {Q, A, P). Denote hj ip a given real measurable function. We consider the 
additive regression function associated to m^(Y) defined by, 

m^(x) = |X = x), Vx = (xi,...,Xrf)GM^ (1) 



in 



1 



= fJ' + ^mi{xi) := m^^addi^)- (2) 
1=1 

Let Ki, K2, K3 and K, be kernels respectively defined on M, R'^^-'^, M"^ and M'^. We denote 
by fx the estimate of /, the density function of the covariable X, (see (l|)), that is, 



Th'ip Jq \ hx 

where (/i^) is a positive real function. In estimating the regression function defined in ([1]), 

I' i 

we use the following two estimators (see for exemple (3) and (5')) 

m^,T(x) = / WTA^)4j{Y,)dt with WtA^) = (3) 



and 



m^,T,/(x) := / W^Ax)ijiYt)dt with W^^x) 
Jo 



T/ii,t4tVt(X,) 



(4) 



where {hj^T),j = 1,2 are positive real functions. Let qi, ...,qd be d density functions defined 
in M. Setting g(x) = Y['i=iQii^i) g_;(x_;) = njy«'?j(^j)- To estimate the additive 



components of the regression function, we use the marginal integration method (see (j6|) and 
(J). We obtain then 

r]i{xi) = / m^{y.)q_i{yi_i)dy._i - I m^(x)g(x)cix, Z = l,...,(i, (5) 

in such a way that the following two equalities hold, 

r]i{xi) = mi{xi) - / mi{z)qi{z)dz, l = l,...,d, (6) 

m^(x) = V'r7i(x/) + / m^(z)g(z)(iz. (7) 

In view of (E]) and ([7]), we note that/// and are equal up to an additional constant. 
Therefore, rji is also an additive component, fulfilling a different identifiability condition. 
From (jl]) and ([5]), a natural estimate of this l-th component is given by 



Viyxi) 



/ m^,r,;(x)g_z(x_i)rfx_; - / m^^T,ii^)li^)(^^^ l = l,...,d, 
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from which we deduce the estimate m^;r,add of the additive regression function, 

d „ 

rh^,T,add{^) = y^r}i{.xi)+ j m^,r(x)g(x)(ix. (9) 

1=1 

Before stating our results, we introduce some additional notations and our assumptions. 
Let Ci,..., be d compact intervals of M and set C = Ci x ... x Cd- For every sub- 
set 8 of M^, g > 1, and any 5 > 0, introduce the 5-neighborhood 8^ of 8^ namely, 
8^ = {x.: infyg£ ||x — y\\wi < S}, with || • W^q standing for the euclidian norm on W. 

(C.l) There exists a positive constant M such that \ip{y)\ < M < oo. 

(C.2) The function is fc-times continuously differentiable, k > 1, and 



sup 



(x) 



< oo; i = 1, d. 



Denote by fi, £ — the density functions of X^, i — 1, The functions / and 

fiji — 1, d, are supposed to be continuous, bounded and 

(F.l)Vx e C^, /(x) > and /^(x^) > 0, £ ^ 1, d. 

(F.2) / is A;'-times continuously differentiable on C^,k' > kd. 

(F.3) For all < A < 1, ^f^(x') - ^f^(x) < L||x' - x||^ with ji + ... + ja = k'. 
Where ||.|| is a norm on and L is a positive constant. 

The kernels Ki, K2, and K are assumed to fulfill the following conditions 

(K.l) Ki, K2, K3 and K are continuous respectively on the compact supports Si C Ci, 
,52 C C2 X ... X Cd, S3GC and S, 

(K.2) /X = 1 and/K, = 1, j = 1,2,3, 

(K.3) Ki, K2 and K3 are of order k, 

(K.4) K is of order k'. 
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(K.5) i^Ti is a Lipschitz function. 

The density functions qi, £ — 1, ...,d, satisfy the following assumption 

{Q.l) For any I < I < d, has k continuous and bounded derivatives, with a com- 
pact support included in Cg. 

There exists a set F e B^2 containing D = {{s,t) e M.'^ : s — t} such that 

(^■1) /(x„y,),(x,,y,) -/(x„y.)(8)/(x,,yo exists everywhere for (s,i)eF^, 

{D.2) Af{T) := sup(, ,)grc sup^y^c^xc^ Iu,veR^ |/(x.,y.),(Xt,yt)(x, u, y, v) 
- f{y.,,Y,){^,u)fpi^^Yt}{y,t)\dudv < oo, 

{D.3) there exists £r < oo and Tq such that, VT > To, ^ Jj^ T]2nr ^"^^^ — ^r- 

We work under the following conditions upon the smoothing parameters hr and hj^r, j = 1,2, 

/ X l/(2fc'+(i) 

{H.l) hr = c' (^] , for a fixed < c' < oo, 

{H.2) hi,T = ciT-i/(2fc+i) and /ia.T = czT-^/^^fc+i), for fixed < a, C2 < oo, 

{H.2y = Ci(M)V(2/c+l) ^^^^ ^ c2(i^)V(2fc+l)^ fo, fi^ed < Ci,C2 < OO. 

Throughout this work, we use the a-mixing dependance structure where the associated 
coefficient is defined, for every cr-fields A and B by 

a{A,B)^ sup \P{Ar]B) - P{A)P{B)\. 

{A,B)e{A,B) 

For all Borehan set / in M+ the cr-algebra defined by {Zt, t E I) is denoted by a{Zt, t E I). 
Writing a{u) = sup^g^^ a{a{Zy, v <t), a{Zy, v >t + u)), we use the condition 

(Al) a{t) = 0{t-'') with 6 > 2d +10+^. 
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Theorem 1 Under the conditions {A.l), {C.l) - {C.2), (F.l) - (F.3), {K.l) - {KA), {Q.l), 
{D.l) - {D.3) and (H.l) - {H.2), we have, for all x G 

Theorem 2 Under the conditions (AA), (C.l) - (C.2), (F.l) - (F.3), (KA) - {K.5), (QA), 
(DA) - {D.3) and (HA) - {H.2)' , we have 

sup |m^,T,add(x) -m^(x)| = 0\[--^j 1 a.s. 



2 Proofs 

The proofs of our theorems are spht into two steps. First, we consider the case where the 
density is assumed to be known. Subsequently, we treat the general case when / is unknown. 
Denote by r), m^^T(x) and m^^T,i{^) the versions of r), m^_T(x) and m^^T,i{^) associated to 
a known (formally, we replace fx by / in the expressions ([3]), (jl]) and m^^T,i{'^) by m^^T,ii?^ 
in (ED. 



Introduce now the following quantities (see, for the discrete case (jj)), we establish the proof 
for the first component, 

d « 

m^,T,add{^) =y2^^^^^^ ~^ mv,T(x)g(x)dx. (10) 
1=1 

Y^,T,t = m) [ 4T^2f^^^^f^)77^^%i^rfx_i, (11) 



^(U-l)=/ -^i^2(^^^^7^^)g-l(X-l)rfx_i, (12) 



ai(xi) = —3— f r^fy\ Ki( ^\ ^^'^ )dt, for xi E Ci, (13) 

inrixi) = E{Y^^T,t\Xt,i= xi), (14) 

« d 

Ct = /U+ / V'mj(Mj)^(u_i)(iu_i, (15) 

Ct = m^,T,i(x)g(x)(ix, (16) 



C = mi{xi)qi{xi)dxi. (17) 



The following Lemma is of particular interest to establish the result of theorem ([T]). Note 
that f|T9|) is "only" be instrumental in the proof of fl20|) . 

Lemma 1 Under the assumptions {C.l) - {C.2), (F.l) - (F.2), {K.l), {Q.l) and {H.2) , we 
have 



E{CT-CT + Cf = (T-^k/{2k+i)^ ^ ^ 
Var(di(xi)) = C)(^T-2fc/(2fc+i)j^ (19) 
E(Ji,{x,)-Vi{x^)f = o(^T-W+i)y (20) 

Proof: According to Fubini's Theorem and under the additive model assumption, we have 



E{Ct - Ct) = e\ m^^T.iW^Wc^x - /i - / y^mj(Mj)g(u^i)(ju„i \ 

= / E(m^,T,i(x))g(x)(ix - /i - / mj(Mj)^(u_i)(iu_i 

= / T^m^(u)^(u_i) / Ki(^ — —^qi{xi)dxidu 
jRd ii'ht Jr ^ n.i,T / 



-/i- / mj{uj)Q{u^i)du^i 



~[ jRd il'l,T Jr ^ il'l,T ^ 

« d 

— / y^mj(Mj)g(u_i)(ju^i 

= I I ■7^mi{ui)Ki( ^^ ^^ )qi{xi)dxidui. 
Jr Jr '^i,t ^ iI'1,t ^ 

Setting vihi^T = xi — ui and using a Taylor expansion, we get, by (C.2) and {K.l) — {K.3), 
K{Ct — Ct) — C = [ [ qi{xi)mi{xi — hi^TVi)Ki{vi)dvidxi — C 

qi{xi)[mi{xi — hi^TVi) — mi{xi)]Ki{vi)dvidxi 





+o{h'l 



k \ 



~^i,T) ''Krnf)^x^)]K^^y^)dvidx^ (21) 



Under {H.2), it follows that, 



E 



{Ct- 



Ct — c 



1 2 



0{T 



-2A;/(2A;H 



(22) 



The Fubini's theorem gives us 

1 



Var(C: 



T 



Var 



1 



t,s6[0;T]2 



hi,T 



hi,T 

qi{yi)dyi ]dsdt. 



(23) 



Under (C.l), [F.l), (K.l) — {K.2) and (Q.l), there exists a finite constant M3 such that, for 
T large enough, 

infja : p(|^g(X,,,i) ^ i^i ( "^^ ~ ^^'^ )gi(a;i)rfa;i > = o} < /ii,tM3. 



Thus, using the Billingsley's inequality and the condition (A.l), 



8M| 
2^2 



atdtds = O 



se[0:T] Jte[0,T-s] 



Var(C'r) < 

Finally, by combining the statements ( |22l) and ( 12^ . we obtain ( ITS 
Proof of ( fiPj) . Recalling (fT3l) . we have 



T 



(24) 



Var(di(xi)) = ^ 



Gov 



[o,T]2nr 



1^, 



-^1 



/l(^s,l)/il,T 
+ 



[o,T]2nr<: V/i(X,,i)/ii,T 



hi: 



fliXs,l)h,T 

A + B. 



hi,T 



dsdt 



(25) 



For the first term, noting that, under (C.l), {F.l), {K.l) — {K.2) and (Q.l), there exists a 
finite constant M4 such that, for T large enough. 



M4 > inf <^ a : P 



y2 
/l(^0,l) 



Ki 
7 



xi — X( 



0,1 



> a = 



Thus, we have 



A < 



< 



E 



T ^[o,r]2nr 



Ma 



T ^[o,T]2nr 



/i(-^o,i; 

I'l — u 



Xi — Xqi 



T 



hl,T 

\fi{u)\dudsdt 



dsdt 



< 



(26) 



To treat the second term, we introduce the set Sa{T) = {(Sj^) £ 1^^; 1^ ~ < a{T)}, where 
a(T) = h^^, we have 



B = 



+ 



J[o,T]2nr=n5„(T) ^Ji[^t,i)'i-i,T ^ 1i,t ' 



1 

2^2 



[o,T]2nr-ns=(^) 

h 



E + F. 



Ki{—^ -^^sdi 



(27) 



Under the conditions (C.l), (F.l), (-fC.l) — {K.2) and (Q.l), there exists a constant M5 such 
that, for T large enough. 



sup 

ziGK J(j/,z_i)eIRxR<*-i 

Consider now the term E, we have 



f ^(?/)g(z-i) ^^ 

i(j/,z_i)eIRxRrf-i /(z) ^ /il,T ^ 



/ / 



dydz^i < M5. 



V^(y)^(z_i) 



T'^h\ T 7(s,t)e[o,T]2nr=nS„(T) -'(u,v)eiRxM'' ^(j/,z)eKxiR'^ /l^^) 



^ - Xl - VXM)g(v_i) ^^ pi - t^l 

^ h\,T ^ /(v) V /ii,T 



/n,Xt,n,x,(M,v,2/, z) 



- /yt,6/x, (ti, ^)fY,,b}x^ {y, z)) dydzdudvdsdt 
^ 2a{T)Ml\\K,\\lAf{r) 



T 



(28) 
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Noting that, under the conditions (CI), (F.l), {K.l) — {K.2) and (Q.l), there exists a finite 
constant Mq such that, for T large enough. 



Mfi > inf <^ a : P 



Y, 



Ji(^o,i 

Using the Bilhngsley's inequahty, it follows that 

2 



Xl — Xqi 



T 



> a] = 



F < 



< 



4:MQa{u — v)dudv 



< 



ml 

Th\ j- J{t>a(T)} 

8M2 



a(t)dt 



La{T)-\ 



(29) 



Finally, combining the hypothesis {H.2) and the statements (l25l) and (l29l) . we obtain (|T9l) . 
Proof of (dOj. We have 



E(di(a;i)) - mT^xi) 
1 



mT{ui)Ki{^ — —)dui-mT{xi) 
[ffiTixi - vihi^x) - fhT{xi)]Ki{vi)dvi 



/ / [m^{xi - Vihi^T, u_i) - m^(xi, u_i)]g{u_i)du_iKi{vi)dvi 

{-h,^^v,Y d^m^_^^^^ A g{u_,)du_,K,{v,)dv, + o{hl^). 




Under the condition {H.2), we obtain 



E( di(xi) — rriTixi 



Thus, we have 



E( ai(xi) — rriTixi 



E( di(xi) — mT(a;i) ) + Var(di(xi)). 



Consequently, by combining the following inequality 

E(^i(a;i) - (a;i))' < 2E(di(a;i) - mT(xi))' + 2E{Ct - Ct - C)\ 
and the statements (!30|) . (13T1) . (fT9|) and (l32l) . the proof of (120|) is readily achieved. 



(30) 



(31) 



(32) 
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2.1 Proof of Theorem [T] 

Using the classical inequality (a + 6)^ < 2(a^ + 6^), if follows that, for all x G C, 

:= /i(x)+/2(x). (33) 

First, consider the term Ji, we have 

/i(x) = 2E(m^^T,add(x) - m^(x))^ 

< AdJ^Eimixe) -Ve{xe)f + 4:E / (m^,T(x) - m^,T(x))g(x)rfx . (34) 
e=i 

Arguing as in proof of Lemma ([1]), we obtain 

Ct — Ct — C = I m^^T(x)g(x)c?x— /i— / y^jnj{uj)Q{\v_i)d\v_i — I mi{xi)qi{xi)dxi, 

r. d 

j'(x)g(x)c/x — /i — / y ^mj{uj)q{n)du + 0[h\. 



(m^,T(x) - m^,T(x))g(x)rfx + of^-'=/(2fc+l)^ _ 



It follows that. 



E 



y"^(m^,T(x)-mv,,T(x))g(x)rfx]' < 2e{Ct - Ct - cf + o{t~''^'^''^+^^') . {'ih) 



By combining (IMl), (ESI), ([T8]), and (EOj), we conclude that, for all x G C 

/i(x) = o(t-2^-/(2^-+i)). 

Turning our attention to /2(x), it holds that, 

Eifh^^TMdi?^) - rh^,T,addi?^)f 
= E 



(36) 



y'(r7^(x^) - r]i{xe)) + / m^^T{^)q{x.)d:>^ - 
e=i -^^^ 

d „ 

< Ad'S^Ef / (m^,T/(x) - m^,T/(x))g(x_^)(ix. 
7^1 ^J^'-' 



m^,T(x)g(x)(ix 
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+4rfV'E( / (m^^T/(x) - m^^T,£(x))g(x)(ix 
+2E I / m^^T(x)g(x)(ix — / m^^Tip^)q{'^)d^ 

d „ 

< AdS^E j (m^,T/(x) - m^,T/(x))^g^(x_^)(ix 

d „ 

+4(i^E / (m^^T/(x) - m^,T/(x))^g^(x)rfx 
2E (m^,T(x) - m^,T(x))^g^(x)rfx 

d „ 

- ^^Xl / -E(m^,T/(x) - m^,T/(x))^g^(x_^)(ix 

d „ 

+2 / E{m^^T{^) - m^,T(x))^g^(x)(ix 



Using the decomposition 1// = 1//^ + {fx — f)/{fTf), it is easily shown that for some 
positive constant Mi < oo, we have, under {Q.2), for all x G C and T large enough, 



< MiE 



2 



1 



hi rh' 



d-i 

2,T 



Ki(—, —)K2\ 



hiT ^ V h 



l'2,T 



X sup|/t(x) -/(x) 
xec 



It's easily seen that under our assumptions, following the demonstration of Theorem 4.9. in 
p. 112 and replacing log^ by 1, we have, 

//logT\^'/(2A:'+<i)N 

sup |/t(x) - /(x)| = 0{^{^-^^ j j almost surely , 

We conclude that, for all x G C, 
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2.2 Proof of Theorem H 

In the next lemma we evaluate the difference between the estimator of the additive 
regression function m^^T,add-i continuous time process, and the estimator m^.a^add where 
n G N. 

Lemma 2 For n G N large enough, there exists a deterministic constant C such that for all 
uj in Q and for all T in [n, n + 1[, 

/lo (T^ \ ^ 

\m^,TMd{^){^) - Em^^T,add{^){^) - rh^,n,add{^){^) + ^m^,n,add(x) (u;) | < C j 

Proof: It is sufficient to prove that V G ^2, VT G [n, n + 1[, 



k _ 
1 



\m^,T,add{A^) - m4',n,add{^>{^)\ < C j 

the other part being a trivial consequence of this inequality. Moreover, in view of ([H]) and 
(ITU]) , we can establish the following inequalities 

/ m^,r(x)(u;)g(x)c/x- / m^,„(x)(u;)g(x)rfx < Ci ( — - — ) (38) 
Jmd J^d \ I / 

/ m^^T,i{^)i^)l-ii^-i)d^~i - m^,„,/(x)(u;)g_/(x_j)dx_; < CM — - — ) ^, (39) 

/ m^,T,Kx)(^)9(x)c?x- / m^,„,/(x)(u;)g(x)(ix < C"( — - — )'^, (40) 

with / = 1, ...d. We just establish the first inequality, the techniques being the same for ( l39ll 
and (HOj) . For fixed in i7 and x in R'', we have, for n large enough, 

y^C^^ir3(^^)g(x) = 0, Vt>n. 

So, by Fubini's Theorem 

/ m^,T(x)(a;)g(x)rfx = — ^ / / ^^y^K,{—-^)qi^)d^dt 

Iff V^(Ft(cj)) ,x- Xt(cj), , , ,^,1, 

= TfTiT / frVr O g(x)c/xrft + 0(-) 

= 1 / I ^f-';'V3("-^''"'Mx)dxdt + 0(l) 

'^^It i[0,n] V /(Xj(u;)) /ll,T T 

= - / / f/v l''!^^ -^3(u)g(X,(a;) + u/^i,T)ciurft + 0(1). 

^ i[0,n] V /(Xt(^)) T 
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Denoting M7 := sup^gc^ j^^k 7^ < 00, we have 



m^,T(x)(t^)g(x)(ix - / m^,„(x)(t^)g(x)(ix 



< 



< 



iG[0,n] JuglRd Jl-^U^J 

/ / K^iu){q{Xtiuj) + h,Tn) - qiM^) + hi,n^Ji))dudt + Oih 

J[0,n] JRd 

f f dq 1 

/ / |i^3(u) max || — ||oo||u||(/ii,T - /ii,n)|c?urf)f: + C(— ) 



1 

n 

Mj 
n 

dMj 
n -'[0,71] J S3 



Which imphes ( l38l) by (K.l). This achieves the proof of Lemma El 



(41) 



Set e\T) = c(^^y'^\ where C is a finite constant. There exists a finite number 
r(T) := {?)/ M'h\j.e(T)Y of balls Bp of center Xp and radius h\j.e(T), such that C C Up^j^'Sp, 



where M' is a constant. For each x G -Bp we denote t(x) = Xp. Write now, 



sup \m^^TMd\^) - m^\?<^)\ 

< sup |m^,T,add(x) - m^,T,add{^) \ + SUp \Em^^T,add{^) " "^^(x)] 

x6C xec 

+ sup |m^,T,add(x) - m^,T,add(t(x))| + SUp |Em^,T,add(x) - Efh^^T,add{t{^))\ 

xec xec 

+ sup |m^,add(t(x)) - Em^,arfrf(t(x))|. 

xec 

Thus, to prove the Theorem [21 it suffices to establish the following Lemma. 
Lemma 3 Under the same hypothesis as Theorem\^ we have 

sup \Em^^T,add{^) - "^v>(x)| = 0{h\j), 
xec 

sup |m^,T,add(x) - mv,T,add(t(x))| = 0[e{T) 
xec ^ 

sup |^m^,T,add(x) - Em^,T,add(t(x))|0(£:(r) ), 
xec ^ ^ 

- - / /logTx fe/2fc+i 

sup |m^,T,add(i(x)) - ^m^,T,add(i(x)) I = ^ ( ' ' 

//logT\ /^/Csfc+i)" 
sup |m^,T,add(x) - m^(x)| = 0\{-^^j | a.s. 



(42) 
(43) 
(44) 

(45) 

(46) 
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Proof of 42: We have 



y^iErfii^i) - Vii^i)) + E{ m^^T(x)g(x)rfx) - / m^(x)g(x)rfx. 

JR'i 



By Fubini's theorem, we obtain 



d „ 

Bias(m^,T,add(x)) = V'Bias(r7^(x;)) + / Bias(m^,T(x))g(x)rfx. 



We can write, 



Bias(?7i(xi)) = £;(r/i(xi)) - ?7i(xi) 

= {E{aiixi)) - m^,T(a;i)} + E{Ct - Ct - C) 
■■= (/) + (//)■ 



First consider the term (J), we have 
1 '•^ 



1 /t2,T 



m^(xi,u_i 
/ m^(xi,u_i)^(u_i)(iu_i 



X_i - U_i 



2,T 



g_i(x_i)(ix_i (iu_ 



It follows that, under the conditions (C.2), (^.2) and {K.3) 



1 ~ . . (Xi-Ui 




k-l 



dui — 



2=1 ^ 




k\ dx\ 



{xi - 9hi^TVi,u_i] 



Thus, we obtain 



k\ dxi 
sup \E{ai{xi)) - m^,T{xi)\ = O {h\ j) . 



Q{vi^i)dvi^iKi{vi)dvi. 
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Next, turning our attention to (//), by (!2T]) we have 

E{Ct-Ct)-C = 0(/itr)- (50) 
Combining (149|) and (150|) . it follows that 

sup - = O (hlj.) . (51) 



On the other hand, we have, for all < < 1, 



Bias(m^r(x)) := .Em^ ^(x) — m^(x) (52) 
= / [m^(x + /ii^tv) -m^(x)]i^3(v)(iv. 



/ E 4f77^r^(^ + ^iW-^^^^^3(v)rfv (53) 



C(/iL 



Combining the decomposition (H71) and the statements (I5T1) and (15^ . we deduce the result 

m. 



Proof of ( f^gp Under the condition {K.5), there exists a constant M such that 
1 M 

- / |Z,(X) - Z,(t(x))|rft < J2 T^l^l - 

Consequently, using the expression of r(T), we obtain 

sup \rh^,T,add{^) - m^,T,add{t{^))\ = C(e(T)). 
xec 

Proof of [44\l- Similarly as above, we may deduce fj44l) . 

Proof of ([T^lj; In view of Lemma [2], it is sufficient to prove discrete version of fl45p . that is 
sup \fh^,n,add{t{^)) " ^m^,n,add(i(x)) | = o(e{n)) a.s. (54) 
Set n in N and,introduce some notations. Set, 

1 r 

m^,n,add{^) - Em^^n,add{^) =■ - 6(x)c?t, (55) 

1^ Jo 

where 

= 6(u) := (Zi(u) - i?(Zi(u))) 
15 



and 



+ 



1 /■ f^-y^t 



f ^3 f ^V^) ?(x)cix. 
7]Rd-i \ fti,n / 



Finally, we use the notation 

1 r'p n 

y,"(x) - - / 6(x)dt i = 1, 2?' where P '-^ - ^(^)"'^' (^6) 
J{i-i)p 

So we can write 

rh^,n,add{^) - Em^,n,add{^) = X^^/X^)- (57) 

1=1 

We have to show that the following quantity is summable 

2q' 2q' 

P(sup|5^y,(i(x))| >£(n)) < r(n) sup P(| y,(t^)| > (58) 
Let j be fixed in [l,r(n)]. We have 

n\T.^^itJ)\>e{n))<P{\Y,V,,{t,)\>e{n)/2) + P{\J2V2i-^^^^^^ 

1=1 i=l i=l 

Observing that for a given M", ^j(x)(cj) < Va; G f2, we can use recursively Bradley's 
lemma and define the independent random variables W2{tj), ...,W2q'{tj) such that, Vi e 
[1, q'], and have the same law and > 

P(|l^.(t,)-^.(t,)|>.) < ll(^^^)^«(p)<ll(f5)^"(p)- (59) 
We have, for all < A < ^ 

E^2.(t,)|>^} c {{li:^2.(t,)|>^;|y,(t,)-W^.(t,)|<^ l<i<q'}} 

1=1 

[j[jm{tj)-w,{t,)\>-}]. 



i=l i=l 

q' 
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The choice A=-^^ gives us 



1=1 i=l 

q 



+ Y.p{\V,,{t,)-W,,{t,)\>'-^). (60) 

1=1 



We treat separately the two terms of the last inequality. For the second one, the application 
of ( 159|) under the condition {A.l) drives us to 

5^p(|V,,(t,) - l^,.(t,)| > ^) < = 0{r{nr'n^) (61) 

where < —1. 

In order to dominate p(^\ X]i=i W^2i(tj)| > ^x^j, we must bound the variance of W2i (which 
has the same law as V2i) to use Bernstein's inequality 

< -2 [ mt)dt (62) 

The kernels are bounded, so we can easily see, after a change of variables, that there exists 
a constant M'" such that 

M'" 

E{Z!) < ^, 

witch implies 



H^t) < T- and Var(1^2i(tj)) < 



Observe that, for a given S in M*"*", ^t{^) < Vu; G fi, we readily have 

M' 

E\W,\'' < {p- — f-^p\E\Wi\^,yi. 
nhi^n 

This allows us to apply Bernstein's inequality 

e{n)\ ( e(n)^ 



i^(lE^^(^^)l>^) ^ 2exp(- 

i=\ 



16(i2^ + 4M), 

2^"H-32M + 8M'pe(n))l ^^'^ 
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The expression of p and e{n) gives us pe(n) and the sequence Ylin=i fij>)P{ I XlLi I > 



e(n) 



converges as N grows to infinity if we choose a large enough C in e(n). In view of this 
last inequality and fl6Tl) . we obtain (154|) by Borel-Cantelh. 

Proof of (g^.- By (jlD, we have 

sup m^,T X - m^,T X < M— / i^s -r 

xec mfxec /nx) + o(l) Thf j, Jq V /i^t 

Using the statements ([S]) and ([7]), and the Theorem on a density estimator due to 1^, we 
obtain 

sup |m^,T,add(x) - m^,T,add(x)| 
xGC 

< 2d max sup |m^,T,i(x) - m^,T,/(x)| + sup |m^,T(x) - m^,T(x)| 

l<i<dxGC XGC 

//logT\fe/(2fe+i)\ 
C ( ( 1 a.s.. 



T 
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